Training Elman Neural Network for Dynamical System Identification Using Stochastic Dynamic Batch Local Search Algorithm
نویسندگان
چکیده
In this paper, we propose a Stochastic Dynamic Batch Local Search (SDBLS) algorithm to train Elman Neural Network (ENN) for Dynamic Systems Identification (DSI). First, we propose a new Batch Local Search (BLS) algorithm for ENN from a new angle instead of traditional Back Propagation (BP) based gradient descent technique, then add the stochastic dynamic signal into the network in order to avoid the possible local minima problem caused by the BLS method. Experimental results show that the proposed algorithm has greatly effective performances in the identification of linear and nonlinear dynamic systems in comparison with other algorithms without calculating any derivations. The results conclude that the proposed algorithm is an alternative means of training ENN when the gradient-based methods fail to find an acceptable solution. So the proposed algorithm can be regarded as a new identification approach to identify DSI for the auto-control systems.
منابع مشابه
Training Elman Neural Network for Dynamic System Identification Using an Adaptive Local Search Algorithm
Recurrent neural networks, especially for Elman Neural Network, have attracted the attention of researchers in the fields of Dynamic System Identification (DSI) since they took the memory unit through the context delay. In this paper, we propose an Adaptive Local Search (ALS) algorithm to train Elman Neural Network (ENN) for Dynamic Systems Identification (DSI) from a new angle instead of tradi...
متن کاملSimulated annealing algorithm-based Elman network for dynamic system identification
One of the well-known recurrent neural networks is the Elman network. Recently, it has been used in applications of system identification. The network has feedforward and feedback connections. It can be trained essentially as a feedforward network by means of the basic backpropagation algorithm, but its feedback connections have to be kept constant. For training success, it is important to sele...
متن کاملTraining Radial Basis Function Neural Network using Stochastic Fractal Search Algorithm to Classify Sonar Dataset
Radial Basis Function Neural Networks (RBF NNs) are one of the most applicable NNs in the classification of real targets. Despite the use of recursive methods and gradient descent for training RBF NNs, classification improper accuracy, failing to local minimum and low-convergence speed are defects of this type of network. In order to overcome these defects, heuristic and meta-heuristic algorith...
متن کاملIdentification of Multiple Input-multiple Output Non-linear System Cement Rotary Kiln using Stochastic Gradient-based Rough-neural Network
Because of the existing interactions among the variables of a multiple input-multiple output (MIMO) nonlinear system, its identification is a difficult task, particularly in the presence of uncertainties. Cement rotary kiln (CRK) is a MIMO nonlinear system in the cement factory with a complicated mechanism and uncertain disturbances. The identification of CRK is very important for different pur...
متن کاملA System Identification Using DRNN Based on Swarm Intelligence
Original Elman, which is one of the well-known dynamic recurrent neural network (DRNN), has been improved to easily apply in dynamic systems identification during the past decade. In this paper, a learning algorithm for Original Elman neural networks (ENN) based on modified particle swarm optimization (MPSO), which is a swarm intelligent algorithm (SIA), is presented. MPSO and Elman are hybridi...
متن کامل